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Objectives: Intensified competitiveness in the healthcare industry has increased the number of healthcare centers and propelled the 
introduction of customer relationship management (CRM) systems to meet diverse customer demands. This study aimed to de- 
velop the information system success model of the CRM system by investigating previously proposed indicators within the model. 
Methods: The evaluation areas of the CRM system includes three areas: the system characteristics area (system quality information 
quality, and service quality), the user area (perceived usefulness and user satisfaction), and the performance area (personal perfor- 
mance and organizational performance). Detailed evaluation criteria of the three areas were developed, and its validity was verified 
by a survey administered to CRM system users in 13 nationwide health promotion centers. The survey data were analyzed by the 
structural equation modeling method, and the results confirmed that the model is feasible. Results: Information quality and service 
quality showed a statistically significant relationship with perceived usefulness and user satisfaction. Consequently, the perceived 
usefulness and user satisfaction had significant influence on individual performance as well as an indirect influence on organiza- 
tional performance. Conclusions: This study extends the research area on information success from general information systems 
to CRM systems in health promotion centers applying a previous information success model. This lays a foundation for evaluating 
health promotion center systems and provides a useful guide for successful implementation of hospital CRM systems. 
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I. Introduction 

Increased interest in disease prevention and health promo- 
tion is one of the significant changes in relation to healthcare 
consumption. The leading cause of death has been shifted 
from infectious diseases to chronic diseases in Korea due to 
lifestyle changes, an enhanced level of medical care, greater 
accessibility of medical services, and other factors [1]. Thus, 
treatment-oriented healthcare has shifted toward disease 
prevention and health promotion. 

In recent years, regular health screening has become popu- 
lar as the number of health promotion centers has increased. 
Health promotion has been defined by the World Health Or- 
ganizations 2005 Bangkok Charter for Health Promotion in a 
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Globalized World as "the process of enabling people to increase 
control over their health and its determinants, and thereby 
improve their health" [2] . The number of health promotion 
centers has been increased to promote healthcare from the 
aspect of preventive medicine domestically. These services are 
being provided by health checkups or promotion centers as 
conventional medical services are diversified [3]. The manage- 
rial performance of such services preserves losses which are 
generated from other hospital departments, and it plays a cru- 
cial role in overall hospital management [4]. For these reasons, 
many medical institutions have set up physical examination and 
health promotion centers to provide health screening service. 

As of April 2012, eight hundred and forty-three health pro- 
motion centers operated nationwide [5]. Due to intensifying 
cut-throat competition among health promotion centers, 
providing diversified customer-tailored services has been 
highlighted by analyzing customer's needs for hospitals to 
hold a dominant position. Escalating competition among 
health promotion centers changed the trend of patients visit- 
ing hospital voluntarily. 

Competition among businesses is intensifying as custom- 
ers' demands have diversified. Hence, many businesses are 
pushing to build effective relationships with customers by 
meeting their needs. Likewise, finance, service, distribution, 
communication, and other various industries are making ev- 
ery effort to strengthen customer relationships by introduc- 
ing customer relationship management (CRM) systems. 

The CRM system is a marketing technique that focuses 
on securing and appealing to loyal customers by providing 
differentiated service through customer categorization to 
underscore the importance of customers in the management 
field [6] . The application of CRM systems is acknowledged to 
be beneficial in finding new customers, enhancing customer 
value, maintaining customers, and attracting customers with 
high-return [7,8]. Reichheld and Sasser [9] suggested that 
the net income of service businesses would be increased 
from 25% up to 85% if the attrition rate of clients could be 
decreased by at least 5%. 

The CRM system has been used as a way to maximize 
customer satisfaction by identifying customer needs and 
providing qualitative healthcare services based on patient 
preferences [6]. A favorable relationship between healthcare 
providers and patients not only improves customer satisfac- 
tion but also enables effective communication between them. 
Moreover, it will help improve the quality of health overall, 
and assist in the effective management of chronic diseases 
[10,11]. The CRM system also could create higher profits for 
hospitals. For these reasons, many healthcare providers have 
predominantly built CRM systems in health promotion cen- 



ters. Although the importance of marketing and customer 
management has been underlined in health promotion cen- 
ters, few studies have been conducted on the current domes- 
tic state of CRM system utilization and its accomplishment. 

Therefore, we attempted to establish an information system 
success model for CRM systems to find the crucial factors of 
CRM systems in health promotion centers. This study would 
provide both performance indicators and success factors of 
CRM systems in relation to actual users of such systems in 
health promotion centers. 

1. Theoretical Background 

Although assessing the performance of information systems 
is difficult due to their diverse characteristics, it is a crucial 
part of the process in the information resource manage- 
ment of organizations. Major studies on the performance of 
information system are summarized as follows. DeLone and 
McLean [12] proposed a model assessing the effect of infor- 
mation systems in six sectors including system quality, in- 
formation quality, use of system, user satisfaction, individual 
impact, and organizational impact. 

Although DeLone and McLean received extensive support 
in the performance assessment of information systems and 
enormously influenced later studies [12], their study intro- 
duced many controversial issues at the same time. DeLone 
and McLean [13] proposed the modified information system 
success model, which adds the service quality area. 

In 1995, Pitt et al. [14] proposed a revised model which adds 
the service quality of the SERVQUAL model to the informa- 
tion system success model of DeLone and McLean [13]. They 
proved that the SERVQUAL model used in marketing is applied 
in assessing the service quality of information system through 
an empirical study on information system service quality 

Seddon [15] pointed out the limitations in assessing infor- 
mation system performance inclined to technical areas and 
enforced user characteristics, such as the participation and 
spontaneity of users. Moreover, he emphasized that per- 
ceived usefulness is more desirable in assessment rather than 
usage when the use of information is not spontaneous. 

After conducting a study on 181 subjects in financial busi- 
nesses and 267 information system service users in 1997, 
Myers et al. [16] concluded that system quality, information 
quality, and service quality influence user satisfaction. More- 
over, they emphasized that performance needs to be assessed 
from various aspects, and the effect of each perforamance 
factor should be verified by distingusihing individual perfor- 
mance, group performance, and organizational performance 
as dependent variables. 

Meanwhile, Yusof [17] attempted to extend the existing in- 
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formation system assessment model to the medical field. The 
study introduced a new evaluation framework; human, or- 
ganization, and technology-fit (HOT- fit). Although Yusof's 
HOT-fit framework was proposed to be applied to the fun- 
dus imaging system used in primary medical care facilities 
of the National Health Service in the UK, no further related 
studies have been made [17]. 

II. Methods 

1. Research Model and Hypotheses 

The research model consists of three influential factors, 
namely, system characteristics, utility characteristics, and 
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performance, based on previous studies [12-16] (Figure 1). 
The operational definitions of the variables used in the study 
model are shown in Table 1 . 

2. Research Methods 

Although the study searched publically released statistics on 
health promotion centers for the selection of subject institu- 
tions, no related data were found. Consequently, the 40 health 
promotion centers were selected from nationwide tertiary hos- 
pitals designated by the Ministry of Health and Welfare from 
2012 to 2014. We requested permission to carry out a survey at 
the selected health promotion centers of the selected hospitals 
by informing the directors of each hospital of the purpose of the 




Figure 1. Research model. 



Table 1. Operational definition of variables 



Contruct 


Operational definition 


Item 


Reference 


System quality 


Performance and functionality of informa- 
tion systems 


Ease of use, Affinity, Ease of learning, Ease 
of navigation, Skillful use, Convenience 


[11,16] 


Information quality 


The degree to which information obtained 
from the system meets the requirements 
and expectations of the user 


Accuracy, Timeliness, Ease of understand- 
ing, Relevance, Reliability of information 


[11,18] 


Service quality 


The improvement of convenience and reli- 
ability of service and business process us- 
ing information system 


Reliability of system, Stability, Rapid recov- 
ery, Security, Rapidity 


[11,16] 


Perceived usefulness 


The degree to which a user believes the sys- 
tem is helpful to perform a task 


Prompt proceeding, Improvement perfor- 
mance, Efficiency 


[16,19,20] 


User satisfaction 


The degree to which anoverall system fea- 
tures provides satisfaction to users 


Sysyem satisfaction, Informationsatisfac- 
tion, Overall satisfaction 


[12-15] 


Individual performance 


Positive or negative influence to perform 
individual job using information systems 


Ease of work, Inconvenient in the absence, 
Rapid job performance, Helpful to job 
performance, Stess in the absence 


[12-15] 


Organizational 


Improved financial profit and organization- 


Increase in net profit, Increase in sales, In- 


[21] 


performance 


al efficiency using information systems 


crease in new customer sales, Cost reduce 
in customer management, Cost reduce in 
business processes 
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study. However, only 13 of these health promotion centers were 
included where they answered that the CRM system had been 
introduced. Therefore, questionnaires were distributed to the 
CRM system users working in these 13 health promotion cen- 
ters, and 245 questionnaires were withdrawn (collection rate, 
86.27%). We used 243 collected questionnaires for the analysis, 
excluding two copies with insincere answers. All responses were 
measured using a 5-point Likert scale. 
The PASW Statistics ver. 18.0 (SPSS Inc., Chicago, IL, USA) 
and AMOS ver. 18.0 statistical packages (SPSS Inc.) were 
used for the data analysis. The data analysis comprised two 
phases. In the first phase, the demographic characteristics 
of subjects were identified using the PASW Statistics ver. 
18.0, and then factor analysis and reliability analysis were 
performed on survey items of independent variables. In the 
second phase, path analysis was carried out to identify the 
goodness-of-fit and path coefficient of correlation analysis 
and the study model using the AMOS ver. 18.0. 

3. Research Hypotheses 

1) System characteristics 

System characteristics include the technical factors of infor- 
mation systems. In this study, the system characteristics in- 
cluded system quality, information quality [12], and service 
quality [13,14]. 

The system characteristics of information systems have 
a positive impact on the effectiveness of the user. System 
characteristics, which include system quality, information 
quality, and service quality, affect the behavioural intention 
to use the system and user satisfaction. The system char- 
acteristics also affect both individuals and organizations. 
Finally, the system characteristics affect net benefits [13]. In 
addition, system characteristics affect the usage of and user 
satisfaction with information systems [22,23] . Kim et al. [24] 
suggested that information quality has a relationship with 



Table 2. Characteristic of health promotion centers 



Characteristic 


Frequency (°/o) 


Beds 


601-1,000 


7 (53.8) 


>1,001 


6 (46.2) 


Location 


Metropolitan area 


10 (76.9) 


Gyeonggi province 


1 (7.7) 


Gyeongsang province 


2 (15.4) 


Total 


13 (100) 
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user satisfaction. 

Based on previous studies, we predicted that CRM system 
characteristics have a relationship with utility characteristics, 
which include perceived usefulness and user satisfaction. 
Accordingly, we propose the following six hypotheses. 

HI: System quality will have a positive impact on perceived 
usefulness. 

H2: System quality will have a positive impact on user satis- 
faction. 

H3: Information quality will have a positive impact on per- 
ceived usefulness. 

H4: Information quality will have a positive impact on user 
satisfaction. 

H5: Service quality will have a positive impact on perceived 
usefulness. 

H6: Service quality will have a positive impact on user sat- 
isfaction. 

2) Utility characteristics 

User satisfaction is a useful measure by which to assess the 



Table 3. Characteristic of respondents 



Characteristic 


Frequency (%) 


Gender 


Male 


32 (13.2) 


Female 


211 (86.8) 


Age (yr) 


<30 


62 (25.5) 


30-39 


126(51.9) 


40-49 


41 (16.9) 


50-59 


14 (5.8) 


Education 


High school graduation 


16 (6.6) 


University graduation 


198 (81.5) 


Graduate or more 


29 (11.9) 


Work experience (yr) 


<1 


19 (7.8) 


1-5 


72 (29.6) 


6-10 


69 (28.4) 


>10 


83 (34.2) 


Work areas 


Doctor 


3(1.2) 


Nurse 


153 (63.0) 


Administration 


32 (13.2) 


Other 


55 (22.6) 


Total 


243 (100) 



www.e-hir.org 113 



Wona Choi et al 

effectiveness of information system users [25]. Some previ- 
ous studies have proposed that utility characteristics should 
include usage and user satisfaction. However, other studies 
have emphasized that the performance of an information 
system should be evaluated in terms of its perceived useful- 
ness rather than actual usage in cases in which system accep- 
tance is involuntary [14,16]. User utility characteristics also 
include perceived usefulness and user satisfaction [15,18]. 
System acceptance of CRM systems in health promotion 
centers is involuntary; therefore, based on previous studies, 
we define user utility characteristics to include the perceived 
usefulness of a system and user satisfaction. 

Many studies have demonstrated the relationship between 
perceived usefulness and user satisfaction [22,26]. Based on 
the findings of previous studies, we propose that high per- 
ceived usefulness would lead to user satisfaction. As a result, 
the following hypothesis was proposed. 

H7: Perceived usefulness will have a positive impact on user 
satisfaction. 

3) System performance 

Information systems include a variety factors in organiza- 
tion. The performance of information systems cannot evalu- 
ate separately. In this study, the considered performance 
factors included individual performance factors and organi- 
zational factors, based on previous studies [12,13,15,18]. We 
established four hypotheses related to the relationship be- 
tween users utility, which included perceived usefulness and 
user satisfaction, and performance factors. Organizational 
performance was measured in terms of financial perfor- 
mance because it is difficult to measure performance created 
by information systems. 

H8: Perceived usefulness will have a positive impact on indi- 
vidual performance 

H9: Perceived usefulness will have a positive impact on or- 
ganizational performance 

H10: User satisfaction will have a positive impact on indi- 
vidual performance 

Hll: User satisfaction will have a positive impact on orga- 
nizational performance 

Information performance was measured in terms of indi- 
vidual performance and organizational performance, ac- 
cording to many studies [12,14]. In this study, we posited a 
hypothesis about the relationship between individual per- 
formance factors and organizational performance factors to 
examine the relationship between performance factors. 

H12: Individual performance will have a positive impact on 
organizational performance 
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III. Results 

1. General Characteristics of Health Promotion Centers 
and Respondents 

The characteristics of the health promotion centers consid- 
ered in this study are shown Table 2. There were 7 centers 
(53.8%) with 601-1,000 beds and 6 centers (46.2%) with 
more than 1,001 beds. Moreover, 10 hospitals (76.0%) were 
located in metropolitan areas, and three hospitals were lo- 
cated in non-metropolitan areas, that is, the South Gyeonggi 
(7.7%) and Gyeongsang Provinces (15.4%), respectively. 

The demographic characteristics of respondents are sum- 
marized in Table 3. The 13.2% of the respondents were men 
and 86.6% were women. By age, 62 respondents (25.5%) 
were below 30 years of age, 126 respondents (51.9%) were 
between 30-39 years of age, 41 respondents (16.9%) were 
between 40-49 years of age, and 14 respondents (5.8%) were 
between 50-59 years of age. By educational background, 
high school graduates were 16 (6.6%), college graduates 
were 198 (81.5%), and respondents above a post-graduate 
degree were 29 (1 1.9%). By work experience, 19 respondents 
(7.8%) had less than a year of work experience, 72 (29.6%) 
had two to five years of work experience, and 83 (34.2%) 
had six to ten years of work experience. By work field, three 
respondents were doctors, 153 respondents were nurses, 32 
respondents were administrative staff members, and 55 re- 
spondents were other workers. 

2. Reliability and Validity 

First, the validity of the evaluating factors was tested through 
exploratory factor analysis. The study used the varimax, the 
most commonly used orthogonal factor rotation. Cronbachs 
a value, representing the average value of repeatedly mea- 
sured data, was calculated to assess the reliability. Each sur- 
vey item was considered to exhibit internal consistency if it 
expressed reliability of 0.886 or above. Thus, the factors com- 
prising this study model are thought to have high reliability 
and internal consistency [27] . The results of the exploratory 
factor and reliability analyses are shown in Table 4. 

Second, we tested for reliability and validity using confir- 
matory factor analysis (CFA). 

For the measurement model, CFA revealed a good model 
fit, chi-square/degree of freedom (x 2 /df, 2.66), goodness-of- 
fit index (GFI, 0.777), adjusted GFI (AGFI, 0.830), normal- 
ized fit index (NFI, 0.865), comparative fit index (CFI, 0.919), 
and root mean square residual (RMR, 0.04) [23]. In this 
study, these were within acceptable levels. 

The convergent validity of each construct was evaluated 
(Table 5). The criterion for assessing adequate convergent va- 
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lidity was the average variance extracted (AVE), which is the 
average variance that is shared between a construct and its 
measures. Convergent validity is adequate when constructs 
have an AVE loading greater than 0.5, which means at least 
50% of the measurement variance was captured by the con- 



struct. All constructs demonstrated AVE scores greater than 
0.5, which is the minimum recommended score. 

Following the convergent validity assessment of the mea- 
surement model, the discriminant validity of each construct 
was evaluated. Table 6 presents the AVE for each construct 



Table 4. Factor analysis and reliability analysis 



Factor loading 

Contruct Item Cronbach's a 







F1 


F2 


F3 


F4 


F5 


F6 


F7 




System quality 


SQ5 


0.804 


0.236 


0.019 


0.179 


0.137 


0.196 


0.058 


0.919 




SQl 


0.794 


0.158 


0.199 


0.075 


0.206 


0.081 


0.109 






SQ3 


0.787 


0.063 


0.088 


0.149 


0.244 


0.142 


-0.031 






SQ4 


0.758 


0.216 


0.049 


0.330 


0.085 


0.089 


0.125 






SQ6 


0.741 


0.208 


0.061 


0.321 


0.091 


0.217 


0.082 






SQ2 


0.668 


0.185 


0.188 


0.123 


0.203 


0.097 


0.215 




Perceived 


PU4 


0.225 


0.810 


0.176 


0.285 


0.142 


0.176 


0.074 


0.953 


usefulness 


PU3 


0.209 


0.790 


0.207 


0.249 


0.217 


0.253 


0.032 






PU5 


0.215 


0.729 


0.172 


0.298 


0.250 


0.161 


0.209 






PU1 


0.291 


0.726 


0.098 


0.239 


0.283 


0.249 


0.148 






PU2 


0.250 


0.721 


0.152 


0.222 


0.279 


0.267 


0.171 




Organizational 


OP2 


0.098 


0.163 


0.885 


0.155 


0.139 


0.173 


-0.020 


0.930 


performance 


OP1 


0.098 


0.112 


0.870 


0.150 


0.152 


0.166 


-0.011 






OP3 


0.055 


0.112 


0.859 


0.104 


0.144 


0.187 


-0.070 






OP4 


0.151 


0.121 


0.764 


0.026 


0.245 


0.063 


0.291 






OP5 


0.198 


0.127 


0.723 


0.062 


0.287 


0.128 


0.324 




Information 


IQ1 


0.228 


0.227 


0.150 


0.714 


0.231 


0.346 


0.075 


0.925 


quality 


IQ3 


0.404 


0.303 


0.106 


0.688 


0.141 


0.118 


0.074 






IQ5 


0.183 


0.255 


0.177 


0.665 


0.351 


0.330 


0.040 






IQ2 


0.357 


0.312 


0.145 


0.664 


0.149 


0.170 


0.215 






IQ4 


0.286 


0.326 


0.142 


0.663 


0.159 


0.168 


0.223 




Individual 


IP2 


0.211 


0.240 


0.163 


0.084 


0.783 


0.131 


0.087 


0.912 


performance 


IP4 


0.192 


0.140 


0.276 


0.158 


0.777 


0.191 


0.170 






IP3 


0.163 


0.257 


0.253 


0.159 


0.750 


0.207 


0.134 






IP5 


0.215 


0.155 


0.243 


0.250 


0.711 


0.036 


-0.132 






IP1 


0.258 


0.243 


0.199 


0.252 


0.616 


0.199 


0.313 




Service quality 


SVQ2 


0.168 


0.215 


0.254 


0.207 


0.151 


0.738 


0.160 


0.886 




SVQ4 


0.155 


0.145 


0.224 


0.194 


0.135 


0.710 


-0.057 






SVQ3 


0.265 


0.202 


0.244 


0.231 


0.155 


0.677 


0.215 






SVQ1 


0.166 


0.291 


0.072 


0.464 


0.361 


0.530 


0.018 






SVQ5 


0.309 


0.372 


0.205 


0.167 


0.246 


0.514 


0.306 




User 


US1 


0.304 


0.410 


0.163 


0.298 


0.249 


0.199 


0.552 


0.910 


satisfaction 


US2 


0.331 


0.378 


0.178 


0.445 


0.132 


0.160 


0.537 






US3 


0.251 


0.370 


0.186 


0.390 


0.213 


0.308 


0.518 




Eigen-value 




17.303 


2.992 


1.886 


1.539 


1.171 


0.977 


0.820 




Percentage of variance 


50.891 


8.799 


5.547 


4.525 


3.444 


2.875 


2.412 


78.492 



explained 
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Construct 


Item 


Estimate 


SE 


CR 


Stadardized factor loading 


Significance AVE 


System quality 


SQl 


1 


- 


- 


0.789 


0.654 




SQ2 


0.851 


0.072 


11.895 


0.714 


*** 




SQ3 


0.898 


0.068 


13.213 


0.776 






SQ4 


1.124 


0.076 


14.809 


0.847 


XXX 




SQ5 


1.1 


0.072 


15.24 


0.866 


XXX 




SQ6 


1.106 


0.075 


14.843 


0.849 


XXX 


Information quality 


IQ1 


1 


- 


- 


0.858 


0.712 




IQ2 


1.065 


0.061 


17.362 


0.853 


*** 




IQ3 


0.975 


0.059 


16.455 


0.828 


*** 




IQ4 


1.042 


0.062 


16.77 


0.837 


* * * 




IQ5 


0.982 


0.058 


17.006 


0.844 


* * * 


Service quality 


SVQ1 


1 


- 


- 


0.783 


0.614 




SVQ2 


1.139 


0.085 


13.421 


0.800 


*** 




SVQ3 


1.187 


0.086 


13.754 


0.816 






SVQ4 


0.882 


0.078 


11.307 


0.695 


*** 




SVQ5 


1.285 


0.093 


13.763 


0.816 




Perceived usefulness 


PU1 


1 


- 


- 


0.904 


0.805 




PU2 


1.019 


0.045 


22.416 


0.903 


* * * 




PU3 


1 


0.044 


22.925 


0.911 


* * * 




PU4 


1.028 


0.047 


21.721 


0.892 


*** 




PU5 


1.009 


0.049 


20.752 


0.876 


*** 


Individual performance 


IP5 


1 


- 


- 


0.714 


0.686 




IP4 


1.058 


0.081 


13.116 


0.869 






IP3 


1.126 


0.083 


13.5 


0.896 






IP2 


1.118 


0.091 


12.318 


0.816 






IP1 


1.074 


0.085 


12.568 


0.833 


*** 


Organizational performance 


FP5 


1 


- 


- 


0.692 


0.708 




FP4 


0.945 


0.049 


19.11 


0.709 


*** 




FP3 


1.111 


0.087 


12.795 


0.868 






FP2 


1.318 


0.094 


14.052 


0.967 


XXX 




FP1 


1.223 


0.089 


13.682 


0.934 


XXX 


User satisfaction 


US3 


1 






0.891 


0.776 




US2 


1.121 


0.057 


19.652 


0.884 


XXX 




US1 


1.086 


0.057 


18.903 


0.867 


XXX 



SE: standard error, CR: critical ratio, AVE: average variance extracted. 
***p < 0.001. 



and the square of the correlations, between each construct 
and the others. The results support the discriminant valid- 
ity of each of the constructs, as the AVE of each was greater 
than that of the corresponding inter- construct squared cor- 
relation (Table 6). 

3. Suitability of Research Model 

The goodness-of-fit of the proposed model was assessed us- 



ing the GFI, AGFI, NFI, RMR, and CFI [23]. The goodness- 
of-fit of social science was determined based on GFI (>0.9), 
AGFI (>0.9), RMR (£0.08), and NFI (>0.9). The GFI and 
AGFI values of about 0.80 and 0.89, respectively, generally 
indicate acceptable model fit. The GFI and AGFI values in 
this study exceeded 0.90, which suggests a relatively good 
overall fit for the model. 
Figure 2 shows the causal relationship among factors de- 
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termined by conducting the path analysis of each factor. 
According to the test results of the structural model, the 
goodness-of-fit statistics and coefficients were y^lAi, 1.631, 
GFI, 0.838; AGFI, 0.805; RMR, 0.006; and NFI, 0.993; which 
are quite close to the recommended standard of goodness- 
of-fit (Table 7). In this study, neither the GFI nor the AGFI 
values satisfied the recommended threshold of 0.9 or greater. 
However, the GFI and AGFI values may be overly influenced 
by the size of sample [28] . For this reason, some studies have 
recommended the use of less sensitive fit indices, such as 
GFI, AGFI [29]. Therefore, the GFI and AGFI values were 
below 0.9, but these values may be acceptable. The overall 
goodness-of-fit levels in the study are thought to be accept- 
able in anticipating the relationships among variables in hy- 
pothesis testing. 

4. Hypothesis Testing 

This study tested hypotheses presenting the relationships 
among system characteristics, user, and performance of a 
CRM system evaluating areas in health promotion centers. 
Among 12 hypotheses, 9 hypotheses were chosen excluding 
three hypotheses at a significance level of 0.05. The results are 



shown in Table 8. Information quality (path coefficient, 0.310) 
and service quality were found to have a positive influence 
on perceived usefulness. User satisfaction was shown to be 
affected by system quality (path coefficient, 0.177), informa- 
tion quality (path coefficient, 0.257), and service quality (path 
coefficient, 0.296). Perceived usefulness (path coefficient, 
0.334) showed a positive effect on user satisfaction. Perceived 
usefulness (path coefficient, 0.334) and user satisfaction (path 
coefficient, 0.346) had a positive influence on individual per- 
formance. On the other hand, both perceived usefulness (path 
coefficient, 0.078) and user satisfaction (path coefficient, 0.119) 
had no influence on organizational performance. Finally, indi- 
vidual performance (path coefficient, 0.288) exhibited a posi- 
tive effect on organizational performance. 

IV. Discussion 

The CRM system in health promotion center has been 
known as a significant system affecting the competitive- 
ness of healthcare providers. We examined the performance 
of the CRM system and the effect of system characteristic 
factors on individual and organizational performance. The 



Table 6. Discriminant validity 





SQ 


IQ 


SVQ 


PU 


US 


IP 


OP 


SQ 


0.654 














IQ 


0.448 


0.712 












SQ 


0.348 


0.549 


0.614 










PU 


0.356 


0.557 


0.526 


0.805 








US 


0.411 


0.579 


0.497 


0.576 


0.776 






IP 


0.301 


0.383 


0.397 


0.404 


0.379 


0.686 




OP 


0.128 


0.192 


0.286 


0.209 


0.223 


0.309 


0.708 



Average variance extractedare not on the diagonal square correlations are off-diagonal. 

SQ: system quality, IQ: information quality, SVQ: service quality, US: user satisfaction, PU: perceived usefulness, IP: individual per- 
formance, OP: organizational performance. 
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study has reached the following conclusions based on the 
research results. 

First, information quality and service quality were found to 
have an influence on perceived usefulness among the factors 
in the system characteristic area. Moreover, system qual- 
ity, information quality, and service quality all had effect on 
user satisfaction. The outcomes show good agreement with 
the results of previous studies that have underscored service 
quality in the performance of other information systems, 
including DeLone and McLean [13], Pitt et al. [14], and 
Seddon [15]. Information quality and service quality, in par- 
ticular, influenced both perceived usefulness and user satis- 
faction unlike system quality in this study. The results imply 
that service quality providing qualitative information rather 
than the system itself positively influences user satisfaction 
and perceived usefulness. Therefore, enhancing user services 
and providing constant high-quality content are crucial to 
raise the performance of the system. 

Second, although the relationship between the system 
and organizational performance has been a critical issue in 
evaluating the performance of information systems, perfor- 



Table 7. Overall fit of the research model 



Model-fit index 


Recommended value 


Score 


Chi-square/degree of freedom 


<3.00 


1.631 


Goodness-of-fit index 


>0.90 


0.838 


Adjusted goodness-of-fit index 


>0.90 


0.805 


Normalized fit index 


>0.90 


0.993 


Root mean square residual 


<0.08 


0.006 



mance evaluation had not been attempted due to complexity. 
When the study assessed the performance of CRM system 
in hospitals, perceived usefulness and user satisfaction were 
found to directly influence individual performance in terms 
of work efficiency and task performance availability; thus, 
these factors were found to indirectly affect organizational 
performance ultimately. These results confirm that the CRM 
system plays a significant role in the competitiveness of 
health promotion centers. 

The implications of this study are summarized as follows. 

First, the study broadened the scope of research by apply- 
ing the hospital information-centered information system 
performance model as the CRM system evaluation model 
by highlighting the need to assess the CRM system and 
practically analyzing evaluating indicators. Although the 
CRM system was operated separately from ordinary hospital 
information systems, our results show that the same evalu- 
ation standards can be applied in the performance assess- 
ment. Second, the study scientifically laid the foundation 
for evaluating the CRM system in health promotion centers 
and practically provided useful guidelines for CRM system 
operation by obtaining and evaluating data from actual 
CRM system users and determining the factors affecting the 
system performance. Third, the study confirmed the valid- 
ity of the study model by empirically testing the introduced 
model and hypotheses through statistical methods. Fourth, 
the performance of the CRM system needs to be eventually 
affiliated with organizational performance, implying that the 
proposed factors need to be taken into consideration in the 
introduction and expansion phases of the CRM system in 



Table 8. Hypothesis test results 



Hypothesis 




Path 




Standard path coefficient 


f- value 


p-value 


Result 


HI 


SQ 


^> 


PU 


0.071 


0.940 


0.347 


Reject 


H2 


SQ 


-» 


US 


0.177 


2.567 


0.010 


Accept 


H3 


IQ 


-> 


PU 


0.310 


3.413 


0.000 


Accept 


H4 


IQ 


-> 


us 


0.257 


3.018 


0.003 


Accept 


H5 


SVQ 


-> 


PU 


0.561 


5.035 


0.000 


Accept 


H6 


SVQ 


-» 


us 


0.296 


2.652 


0.008 


Accept 


H7 


PU 


-> 


us 


0.334 


3.682 


0.000 


Accept 


H8 


PU 


-» 


IP 


0.334 


3.990 


0.000 


Accept 


H9 


PU 


-> 


OP 


0.078 


0.921 


0.362 


Reject 


H10 


us 


-» 


IP 


0.346 


4.102 


0.000 


Accept 


Hll 


us 


-> 


OP 


0.119 


1.347 


0.178 


Reject 


H12 


IP 


-» 


OP 


0.288 


3.948 


0.000 


Accept 



SQ: system quality, PU: perceived usefulness, US: user satisfaction, IQ: information quality, SVQ: service quality, IP: individual per- 



formance, OP: organizational performance. 
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every evaluation area. 

The study results indicate that achieving competitiveness is 
crucial from the design phase of the CRM system to the sys- 
tem characteristic area. Since perceived usefulness and user 
satisfaction influence individual performance as well as orga- 
nizational performance, sustainable management is essential 
to increase usefulness and user satisfaction. Moreover, all of 
the system characteristic areas affected user satisfaction and 
user satisfaction affected individual performance. Hence, the 
quality of information systems needs to be maximized to im- 
prove user satisfaction. Since organizational performance was 
evaluated in terms of financial performance as perceived by 
employees, strengthening individual performance ultimately 
leads to enhanced financial performance of organizations. 

Despite such important contributions of this study, it has 
the following limitations. 

First, supplementary studies are essential in the future 
since individual characteristics of users were not taken into 
account. When different characteristics and factors affect- 
ing the usefulness and performance of the CRM individual 
users are further examined, a broader CRM system will be 
able to introduce success factors. Second, extended studies 
should be performed that would include more hospitals as 
subjects and would reflect the size or characteristics of hos- 
pitals. Third, collecting data on the characteristics of hospi- 
tals was restricted due to the confidentiality of information. 
No hospital disclosed the number of monthly examinees in 
their healthcare centers or the operational method of their 
information systems. An extended study would be able to 
identify the relationship between the size and characteristics 
of hospital when more data is available, since hospital size is 
distinguishable by the number of examinees. Furthermore, 
when extended studies are performed reflecting the opera- 
tional method of information system on factors affecting the 
performance, a broader CRM system will be able to intro- 
duce success factors. 

A better and more appropriate CRM system will be es- 
tablished in the actual circumstances of health promotion 
centers when more studies are carried out that overcome the 
above limitations. 

Comflict of Interest 

No potential conflict of interest relevant to this study was 
reported. 

Acknowledgments 

This study was supported by a grant of the Korea Health 



Technology R&D Project, Ministry of Health & Welfare, Ko- 
rea (Al 12022). 

References 

1. Hung SY, Hung WH, Tsai CA, Jiang SC. Critical factors 
of hospital adoption on CRM system: organizational 
and information system perspectives. Decis Support 
Syst 2010;48(4):592-603. 

2. World Health Organization. The Bangkok Charter for 
health promotion in a globalized world (11 August 
2005) [Internet]. Geneva, Switzerland: World Health 
Organization; c2013 [cited at 2009 Feb 4]. Avail- 
able from: http://www.who.int/healthpromotion/ 
conferences/ 6gchp/bangkok_charter/ en/. 

3. Cho DY, Kim YJ. The study on characteristics of uni- 
versity medical center users. Korean Ind Econ Assoc 
2009;22(5):2399-420. 

4. Lee SH. Diversification of hospital services in Korea 
[dissertation]. Seoul, Korea: Yonsei University; 1990. 

5. Korean Hospital Association. Medical Institutions & 
Location Information: operating affairs status [Inter- 
net]. Seoul, Korea: Korean Hospital Association; c2013 
[cited at 2013 Jun 1]. Available from: http://www.hospi- 
talmaps.or.kr/hm/frHospital/hospital_list_emergency. 
jsp?&s_mid=020200. 

6. Trepper C. CRM: customer care goes end-to-end [Inter- 
net]. Manhasset (NY): Information Week; 2000 [cited 
at 2013 Jun 1]. Available from: http://www.information- 
week.com/786/crm.htm. 

7. Ngai EW. Customer relationship management research 
(1992-2002): an academic literature review and classifi- 
cation. Marklntell Plan 2005;23(6):582-605. 

8. Bauer HH, Grether M, Leach, M. Building cus- 
tomer relations over the Internet. Ind Mark Manag 
2002;31(2):155-63. 

9. Reichheld FF, Sasser WE Jr. Zero defections: quality 
comes to services. Harv Bus Rev 1990;68(5):105-11. 

10. Beak HS. Research and study on performance analysis 
of hospital CRM system and its improvement [disserta- 
tion]. Seoul, Korea: Yonsei University; 2008. 

11. Almunawar MN, Anshari M. Improving customer 
service in healthcare with CRM 2.0. GSTF J Bus Rev 
2011;l(2):[7p.]. 

12. DeLone WH, McLean ER. Information systems suc- 
cess: the quest for the dependent variable. Inf Syst Res 
1992;3(l):60-95. 

13. DeLone WH, McLean ER. The DeLone and McLean 
model of information system success: a ten-year update. 



Vol. 19 • No. 2 • June 2013 



www.e-hir.org 119 



Wona Choi etal 



Healthcare Informatics Research J~HR 



J Manag Inf Syst 2003;19(4):9-30. 

14. Pitt LF, Watson RT, Kavan CB. Service quality: a mea- 
sure of information systems effectiveness. MIS Q 
1995;19(2):173-87. 

15. Seddon PB. A respecification and extension of the 
DeLone and McLean model of IS success. Inf Syst Res 
1997;8(3):240-253. 

16. Myers BL, Kappelman LA, Prybutok VR. A comprehen- 
sive model for assessing the quality and productivity of 
the information systems function: toward a contingency 
theory for information systems assessment. Inf Resour 
Manag J 1997;10(l):6-26. 

17. Yusof MM, Paul RJ, Stergioulas LK. Towards a frame- 
work for health information systems evaluation. In: 
Proceedings of the 39th Annual Hawaii International 
Conference on System Sciences; 2006 Jan 4-7; Kauai, HI. 

18. Seddon PB, Kiew MY. A partial test and development of 
the DeLone and McLeans model of IS success. Australas 
J Inf Syst 1996;4(1):90-109. 

19. Rainer RK, Watson HJ. The keys to executive informa- 
tion systems success. J Manag Inf Syst 1995;12(2);83-98. 

20. Davis FD. Perceived usefulness, perceived ease of use, 
and user acceptance of information technology. MIS Q 
1989;13(3):319-40. 

21. Agarwal R., Karahanna E. Time flies when you're having 
fun: cognitive absorption and beliefs about information 



technology usage. MIS Q 2000;24(4):665-94. 

22. Halawi LA, McCarthy RV, Aronson JE. An empirical in- 
vestigation of knowledge management systems' success. 
J Comp Inf Syst 2008;48(2):121-35. 

23. Hsieh JJ, Wang W. Explaining employees' extended 
use of complex information systems. Eur J Inf Syst 
2007;16:216-27. 

24. Kim J, Chae YM, Kim S, Ho SH, Kim HH, Park CB. A 
study on user satisfaction regarding the Clinical Deci- 
sion Support System (CDSS) for medication. Healthc 
Inform Res 2012;18(l):35-43. 

25. Lee SH, Jung JI, Lee JR. An empirical study on customer 
satisfaction of health examination center. J Global Acad 
Mark Sci 2000;6:211-31. 

26. Iivari J. An empirical test of the DeLone-McLean model 
of information system success. ACM SIGMIS Database 
2005;36(2):8-27. 

27. Nunnally JC. Psychometric theory. New York (NY): 
McGraw-Hill; 1978. 

28. Byrne BM. Structural equation modeling with AMOS: 
basic concepts, applications, and programming. 2nd ed. 
New York (NY): Routledge; 2010. 

29. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate 
data analysis. 7th ed. Upper Saddle River (NJ): Prentice 
Hall; 2010. 



120 www.e-hir.org 



http://dx.doi.Org/lO.4258/hir.20l3.19.2.1lO 



